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1. A yser -interface method in which items are represented m m audio field by 
5 corresponding synthesized sound sources from whore sounds related to the items appear to 
emanate, the method including the steps of: 

(a) varying an offset between, ati audio-field reference relative to which the sounds sources 
arc located in the audio Geld, and t^prg&giitetion reference determined by a mounting 
configmatteKi of audio -output devices through which the : sound sources are syiKhe&sed: 

10 and 

(b) determiumg md visually indicating the orientation of the audio-field reference relative 
to apredetemtmed indicator refemtet* taking account, at least at a component level of 
any change in value of said offset md any change m value of indieMorrdieranee 
orientation relati ve to the presentation reference* at least where such changes do not 

15 match each other. 



2. A uscr-mterface method according to claim 1, whereto in step (h) the orientation of the 
audio field reference relative to the indicator reference is determined from compensate of 
said offset ami said indicator-referetice ori eutalion without intermediate ^ determination of 
20 said offset mc indicator-refereitce direction. 



3* A user-interface method according to claim 1, wherein m step (b) domination of the 
orientation of the audio field reference relative to the indicator reference Involves the 
intermediate determination of said offset and said imiicator-refemice orientation. 

25 

4* A user-interface method according to claim 1 ? wherein hi step (a) the Mid offset 
comprises a component varied to stabilise audio field relative to one of: 

a user's head; 

a user's body; 

30 ■> a vehicle in which the user is travelling; 

the world, 
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this stabilisation taking account of whether audio output devices used to synthe&ise the 
sound sources are world, vehicle, body or head mounted, and, &s appropriate* rotation of 
the user's bead or body, or taming of the vehicle. 

5 5* A user-interface method according to claim I or claim 4, wherein in step (a) the said 
offset comprises a component varied in response to user input via an input device, 

6. A itser-itilerfeoe method, according to claim, i, wherein step (V) invol ves energising a 
selected indicator etement of a set of such elements in dependence on .the said orientation 

} 0 of the audio field reference .relative to the indicator reference. 

7. A user-interface method according to claim 1 , wherein step (b) involves displaying on a 
display screen an indication of the said orientation of the audio field reference relative to 
the indicator reference, 

13 

8. A user-irU.erJace method according to claim 5, wherein step (b) invol ves indicating the 
said orientation of the audio field reference relative to the indicator reference via a visual 
orientation indicator arrangement that is incorporated into said input device, 

20 0„ A user -interface method ac cording to claim S, wherein said input de vice is a trackball 
device, the visual orientation indicator arrangement being a display screen, 

1 0. A user-imer&ee method according to claim % v/hero'n said input device is a trackball 
device, the visual orientation indicator arrangement being a set of selectively energisable 
25 indicator elements , 

11, A user-interface method according, to claim 8, wherein the location of new item.- 
representing sound, sources in the audio Odd is indicated to a user by using the visual 
orientation indicator arrangement to indicate the orientation of the new sound source 
30 relati ve to said indicator reference. 



Application/Control Number: 10/058,047 
Art Unit: *** 



Page 



12* A nser-iotcr&ce method according to claim 8. whereia the occurrence of an event 
relating to a said item is indicated to a user by using the visual orientation indicator 
mxangemeni to indicate the orientation, of the corresponding sound source relative to md 
indicator reference. 

5 

1% A itser-intftigoe method according to claim 3, Including us$r selection of said 
predetemiiiied, indicator reference from muMpte possible such references, 

J 4 A us$r4nter.fiace method according to claim 1 , wherein the sound sources are rendered 
10 throu^ headphones ami said offset remains unchanged by rotation of the user's head 
relative to their body whereby to stabilise the audio field relative to the user's head; said 
predetermined indicator reference being one of: 

current facing, direction, in which czm step (h) takes account of any changes, at least 
at a component level, m said offset there being no change in (he orientation of the 
1 5. indicator reference relative to the presentation, reference; 

straight-ahead feeing direction m which case step (b) takes account, at. least at a 
component JeveL of both any changes in said offset, and changes in the orientation of 
the indicator reference relative to the presentation reference resulting from rotation of 
the user ft head relati ve to their body; 
20 - a direction fixed relative to the world, k which case step (b) takes account, at least at 
a component level., of both of any changes in said offset* md changes in orknlatioii 
of the indicator re ference relative io the presentation reference resulting ftom rotatioo 
of the user's head relative to the world. 



Application/Control Number: 10/058,047 
Art Unit; *** 



Page 6 



25* *3T A wtsr^inter&ee method according to claim 1 , wherein the sound sources are rendered 
through headphones ami step (a) involves varying said offset in dependence on the rotation 
of the users head relative to their body whereby to stabilise the audio field relative to Che 
user's body; said predetermined indicator reference being one of: 

current facing direction, in which case step (t>) takes account, at least at a component 
30 level of changes k\ sml offset, there being no change in the orientation of the 

indicator reference relative to the presentation reference; 
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~ strmght-ahead lacing direction in which case step (b) takes account, at least at a 
component level of changes in mid offset except thai changes in offset resulting 
from rotation of the user's head relative to their tody are matched out by tfce changes 
in the ori entation of the indicator reference relative to the presentatio n m femice; 
5 - a direction fixed relative to the world, m which case step (b) takes aceon&t, at least at 
a component tevel, of both of changes in said offset, and changes in orientation of 
the indicator reference relative to the presentation reference resulting from rotation; of 
the user's body relative to the world. 

1 0 .A< A uBer^.nterfacc meted according to claim i > wherein the sound sources are rendered 
through headphones md step (a) involves varying said offset in dependence on the rotation 
of the user' s head relative to the world whereby io stabilise the- audio field relative to the 
world; said predaenmned indicator reference being one of: 

current facing direction, m which case step (h) takes account, at least at a component 
15 level of changes in said oi&et, there being no change in the orientation of the 

indicator reference relative to the presentation reference; 

straight-ahead facing direction in which case step (b) takes account, at least <ii a 
component level of changes m said ofhsl except that components of offset changes 
resulting from rotation of the user's head relative to their body are m atched out by the 
20 change* in the orientation of the indicator reference relative to the presentation 

reference; 

a direction fixed relative to the world, in which case step (b) takes account, at least, at 
a component level of changes in said offset except that changes in offset resulting 
from rotation of the user's head relative to the world m- matched out by the changes 
25 in the orientation of the indicator reference rehrtive to the presentation id&&nc& 

17, (Amended) A user-interface method according to claim 12, wherein the 
changes in the said effect include user-commanded changes. 
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A user-im^rface method according to claim 1 /wherein the orientation of the audio- 
field reference relative to a predetermined indicator refeceace has at least two degrees oi 
freedom- 

19. A it^intcrfsce method according to clam? I > wherek the i Mie&tor reference is erne 
of: 

the presentation .reference; 
5 - a current facing direction of the user; 

a stmighi^head feeing direction of the user; 
a world-fixed direction. 

20- An audio us^htfetfacmg method in which each of a plurality of items is rcpre^ntcd 
10 in an audio field, by at temt one respective synthesized soimd source frona where somkIs 
related to the item appear to emanate, the method comprising the steps of: 
(a) setting tire location of each sound scarce relative to an audio-fieM reference.; 
(h) coatrofiifig m offset between the aiidio~:ficld reference md a presentation reference 
deieomned by amounting, configuration of the audio output devices, this offset being 
15 varied both i» response to user input and to achieve a particular stabilisation of the 
audio Gold; 

(c) determining a rendering position for each sound source by cou&iniftg the location of 
the sound source in the audio field with said offset; 

(d) rendering said sound sources at their associated ttndbritigposifiotts m the audio .field; 
20 and 

(e) determining and visually indicating the orientation of thy audi o field reference relative 
to a predetermined indicator reference direction taking account, at least at &<xmiponsnt 
level, of any change in said offset ami any change the orientation of said indicator 
reference direction relative to the presentation reference, at least where such changes 

2 5 do not match each other. 
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j^2I . Apparatus for providing an audio user interface in which each of a plurality of items is 
represented in m audio field by at least one respective syiitb^i^d sowad source from 
where sounds related to the item appear to emanate, the apparatus including: 
30 ~ offset means for varying an offset between an mdio-fuM reference relati ve to which 
the sounds sources are located in the audio field, and a prestation reference 
ctetormtned by a mounting configuration of audio output devices o f the apparatus 

through which the sound sources are synthesitsod; 

orient ation-defennining means for determining the orientation, of the audio-field 
reference relative to a predetermined indicator reference taking account at tezmt at a 
compoii&of level* of any change in value of said offset and any change m vaiue of 
5 ii)d.ica to r-r^fcre^c e orientation relative to the presentation reference., at least where 

such changes do not .match each other; and 

a visual orientation indicator arrangement for visually indicating the said orientation 
determined by the ori.eBtation-deten.nmmg means. 

10 22, Apparatus according to claim 21, wherein the ori entation-det<nininmg means is 
operative to determine the arienta&m of the audio field reference relati ve to the indicator 
reference on the basis of components of said, offset ami md indicator reference orientation 
without intenuediatc determifertion of said offset and imlicator--3referenc& direction. 



15 23. Apparatus according to claim 21, Wherein thy orkntxttioiV'detcnniairig means is 
operative to determine the orientation of the audio field reference relative to the indicator 
reference through tht interni^dtate determination of said offset and said mdicator^&^euce 
orientation, 
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20 24* Apparatus according to claim 2.1, wherein the offset means is operative to vary said 
offset such as to stabilise audio field relative to one of: 
a user's head; 
a user's body; 

a vehicle in which the user is travel Jing; 
25 - the worJd; 

^ this stabil Isation ticking account of whether the audio output devices used to symJhesise the 
sound sources are world, vehicle, body or head mounted, m<i> m appropriate, rotation of 
the user's head or body, or turning of the vehicle. 

25. (Amended) Apparatus according fo claim 21, wherein the offset means i 
operative to vary the said af&et in response to user input via an. input device of the apparatus. 



Application/Control Number: 10/058,047 
Art Unit: *** 



Page 



2& Apparatus according to claim 21, wherein, the visual odmaikm indicator mmgsmenl 
comprises 3 set of selectively euergisable indicator ■elements, one of the orientation- 
dctcmmiiag means m& the visual orientation fodic&iar mm&fflG&\ including mz&m for 
energising a selected, one of the elements in dependence on the dctensural orientation of 
5 the audio Field reference relative to the indicator reference, 

27* Apparatus according to claim 21 # wherein thtf visual orientation indicator arraiigemeat 
comprises a display screen, om of tlie orieaiMiori-dd^rniEiiimg means arid the visual 
orientation iwheator arrangement including -means for causing the display on the screen of 
10 an indication o f the determined orientation of the audio field reference relative to the 
indicator reference, 

28, Apparatus according to claim 25, wherein the visual orientation indicator arrangement 
is incorporated m the input device. 

15 

2% Apparatus according to claim 2>S, wherrio said mput device is a irackb&lJ device the 
visual orientation indicator arrangement comprising a display screen, md one of the 
orientation -ddsrminitig means <md the visual oriemation iodkator ammgertient including 
means for etna-gibing a selected one of the elements in dependence: on the determined 
20 orientation of the audio field reference relative to the indicator reference. 

3ih Apparatus according to claim 28, wherein said input device is a trackball device, the 
visual ori&nidiion indicator anange&ttmt coupling a set of selectively eaergisahle 
indicator elements, md one of the orientation-dettTOisinmg means and the visual orieatafioa 
25 indicator amtngeraertt including means for energising a selected one of the elements in 
dependence on the determined orientation of the audio field reference relative to the 
indicator reference. 
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31. Apparatus according to claim 2& r fiirtbec coinprMog means for indicating the location 
iO of new item representing sound sources m the audio field by us.bg the visual orientation 
indicator arrangement^ indicate the orientation of the new sowad source relative to said 
indicator reference. 
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32, Apparatus according to claim 28, further comprising means far indicating the 
occurrence of an event relating to a said item by using the visual cnieotattoa indicator 
arrangement to indicate the orientation of tire corresponding sound source relative to said 

5 indicator reference. 

33. Apparatus according to claim 21, wherein the orientation of the audio-field reference 
relative to a pratetermined indicator rder^ce has at least two degree of freodom, 

3 0 34. Apparatus according to claim 21 f wherein the indicator reference is one of: 
the presentation reference; 

- a current facing direction of the user; 

a. straight-ahead facing direction of the user; 
a world-fixed direction.. 

15 

35. Apparatus for providing an audio user interface m which each of a plurality of items is 
represented in m audio field by at least one respective synthesized sound source frojro 
where sounds rotated to the item appear to emanate, the apparatus including: 

- ^ control i irttragssmea* for varying an offset between an audio-field reference relative 
20 to which the sounds sources are located m the audio field, and a presentation 

reference determined by * mounting configuration of audio output devices of the 
apparatus through which the sound sources arc synthesized; 
an -oncfitationH)efct mining arrangement operative to determine the orientation, of the 
audio-field reference relative to a predetermined indicator reference taking account, 
25 at least at a component level, of my change m value of Mid otftet and my change m 

value of iodicator-refereiice orientation relative to the presentation reference, at least 
where such changes do wot mutch each other: and 

a visual orientation indicator arrangement for visually indicating the said orientation 
deienoined by the orientation-delearnnhfg. means. 
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represented In an. audio field by at least one respective synthesized sound source from 
where sounds related to the item appear to emanate, the appamus comprising: 

means for setting the location of each said sound source relative to m amlio-ileid 

reference; 

5 - offset means fer controlling an offset between the imdio-field refersn.ee and a 
presentation reference determined by a mounting cottfiguratiort of the audio output 
devices; 

means for deri ving the rendering position of each sound source based on the location 
of die sound source in the audio field and said offset; 
10 ~ rendering means, including audio oufpftf device?, for generating an audio field m 
which, said sound scrojeccs are synChesixed at their associated rendering podtio&s to 
provide sounds related- to the items concerned; Mid 

a visual indicator arrangement for determining and visually indicating the orientation 
of the audio field, reference relative to a predetermined indicator reference taking 
1 5 account, at least at a component level of any change in said offset and any change 

the orientation of said indicator reference direction relative to the presentation 
reference, at least where such changes do not match each other. 

¥? r In apparatus for providing an audio user interne in which each of a plurality of items 
20 is represented in an audio field by at least one respective synthesized sound source from 
where sounds related to the item appear to emanate, an input device comprising: 

at least one user-operable element, with associated sensing mams, fox commanding a 
change in offset between an audio-field reference relative to which the sounds 
sources are located m the audio field, and a presentation reference determined by a 
25 mounting mmfi g«mion of audio output devices through which the sound sources are 

synthesized; and 

- a visual orientation iudicfeor Hnmgonciit for visually indicating the orientation of 
the audio field reference, relative to a predetermined indicator rdcren.es, the visual 
orientation indicator arrangement comprising a set of selectively e&ergisable 
3 0 in di eator elements. 
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38, In apparatus for providing m audio user interface fo Milch each of a plurality of items 
is represented in an audio field by at least om respecti ve synthesized sound source from 
where sounds related to the item appear to emanate, an. mpnt device comprising; 

&t feast one user-operable element, with associated sensing means, for commanding a 
5 change m offset between an audio-licld reference relative to which the sounds 

sources are located in the audio field, attd a presentation reference determined by a 

mounti ng configuration of audio output devices through which the sound sources axe 

synthesized; ami 

a visual orieiomtfon indicator armtgement for visually indicating the orientation of 
10 the audio field reference relative to n predetermined indicator reference, the visual 

orientation indicator arrangement comprising a visual display screen, 
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3% hi apparatus for providing an audio user interface in which each of a plurality of items 
is represented in an audio field by at least one respective synthesized sound source from 
1 5 where sounds related to the bcm appear to emanate, an input device comprising: 

at least one user-operable mechanical elemem with at Um two degrees of freedom 
and aggotiatcd sensing me&tt$, for comm&ndmg a change in of feet beiweea an audio- 
field reference relative to which the sounds sources i\m located in the audio field, and 
a pjresejitatioft reference determined by a mounting cxmOguratbn of audio output 
20 devices ihrougb which the seuml roccs are synthCvSised; and 

a. visual orientation indicator armgemsM for visually indkatmg the orientation of 

K the audio field reference relative to a predetermined indicator reference, the visual 

k 

orientation indicator airangemem comprising nwMnps on mi external surface of the 
user- operable element. 



40. In apparatus fof providing m audio user interlace in which each of a plurality of items 
j® represented i n an audio Held by at least oue respective synthesized sound source from 
where sounds related to the item appear to emanate, the input device of claim 3.9 wherein 
the user-operable element is a trackball. 

41 > In apparatus for providing aa audio user interface in which each of a plurality of fens 
is represented in an audio field by at least one respective synthesized sound source from 



25 



where smrods related to the item appear to emanate, the input device of claim 39 wherein 
the ttser-aperable element m a cylinder that is d&placeable along, mid rotable about, its 
axis. 



